
SCANNING PHASE MEASURING METHOD AND 
SYSTEM FOR A1VORJF,rT AT A VTSTnN\gTATTO] 



Cross-Reference to Related Application 

This application is related to U.S. patent 
5 application entitled "Optical Measuring System" filed 
June 11, 1994 and having U.S. Serial No. 08/262,130. 

Technical Field 

This invention relates to non- invasive measur- 
ing methods and systems and, in particular, to scanning 
10 phase measuring methods and systems for an object at a 
vision station. 

Background Art 

Height distribution of a surface can be ob- 
tained by projecting a light stripe pattern onto the 

15 surface and then reimaging the light pattern that 
appears on the surface. A powerful technique for 
extracting this information based on taking multiple 
images (3 or more) of the light pattern that appears on 
the surface while shifting the position (phase) of. the 

20 projected light stripe pattern is referred to as phase 
shifting interf erometry as disclosed in U.S. Patent Nos . 
4,641,972 and 4,212,073. 

The multiple images are usually taken using a 
CCD video camera with the images being digitized and 
25 transferred to a computer where phase shift analysis. 
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based on images being used as "buckets," converts the 
information to a contour map of the surface. 

The techniques used to obtain the multiple 
images are based on methods that keep the camera and 
5 viewed surface stationary with respect to each other and 
moving the projected pattern. 

A technique for capturing just one bucket 
image using a line scan camera is described in Patent 
No. 4,965,665 but not enough information is available to 
10 do a phase calculation based on multiple buckets. 

Other U.S. patents which show phase shifting 
include U.S. Patent Nos . 5,202,749 to Pfister; 4,794,550 
to Greivenkamp, Jr.; 5,069,548 to Boehnlein; and 
5,307,152 to Boehnlein et al . 

15 U.S. Patent Nos. 5,398,113 and 5,355,221 

disclose white light interf erometry systems which 
profile surfaces of objects. 

In the above-noted application, an optical 
measuring system is disclosed which includes a light 

2 0 source, gratings, lenses, and camera. A mechanical 
translation device moves one of the gratings in a plane 
parallel to a reference surface to effect a phase shift 
of a projected image of the grating on the contoured 
surface to be measured. A second mechanical translation 

25 device moves one of the lenses to effect a change in the 
contour interval. A first phase of the points on the 
contoured surface is taken, via a four-bucket algorithm, 
at a first contour interval. A second phase of the 
points is taken at a second contour interval. A control 
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system, including a computer, determines a coarse 
measurement using the difference between the first and 
second phases. The control system further determines a 
fine measurement using either the first or second phase. 
5 The displacement or distance, relative to the reference 
plane, of each point is determined, via the- control 
system, using the fine and coarse measurements. 

Summary Of The Invention 

An object of the present invention is to 
10 provide a method and system including an optical head 
for making an optical phase measurement of a viewed 
object by generating an image whose intensity varies as 
a function of position relative to the optical head and 
wherein the system is configured in a way which allows 
15 multiple images with different phase information as tjie 
viewed object is moved in a direction perpendicular to 
the imaging system and these multiple images are used to 
calculate a phase image that is proportional to the 
optical phenomena that creates the phase change. 

2 0 Another object of the present invention is to 

provide a method and system including an optical head 
for making a phase measurement of imagable electromag- 
netic radiation returned to a multi-line linear detector 
array by setting up the optics in the optical head in a 

25 manner such that, a different phase value is imaged ontx: 
each line of the detector array^such that each line o£ 
the detector array creates an image with a different 
optical phase value for the same point on the imaged 
object. 
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Yet still another object of the present 
invention is to provide a method and system including an 
optical head for scanning the height of a surface 
wherein the optical head includes a light stripe projec- 
5 tor and imaging system where the projected pattern does 
not move relative to the imaging system and the optical 
head is configured in a way which allows multiple images 
with different phase information as the surface is moved 
with respect to the imaging system and these multiple 
10 images are used to calculate a phase image that is 
proportional to the height of the scanned surface . 

In carrying out the above objects and other 
objects of the present invention, a method is provided 
for high speed scanning phase measuring of an object at 

15 ^ a vision station to develop physical information associ- 
ated with the object. The method includes the steps of 
projecting a pattern of imagable electromagnetic radia- 
tion with at least one projector and moving the object 
relative to the at least one projector at the vision 

20 station to scan the projected pattern of electromagnetic 
radiation across a surface of the object to generate an 
imagable electromagnetic radiation signal. The method 
also includes the steps of receiving the imagable 
electromagnetic radiation signal from the surface of the 

25 object with a detector having a plurality of separate 
detector elements and maintaining the at least one 
projector and the detector in fixed relation to each 
other. Finally, the method includes the steps of 
measuring an amount of radiant energy in the received 

3 0 electromagnetic radiation signal wherein the detector 
elements produce images having different phases of the 
same scanned surface based on the measurement and 
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computing phase values and amplitude values for the 
different phases from the images. 

In one embodiment, preferably the physical 
information is dimensional information and the imagable 
5 electromagnetic radiation is light. 

In another embodiment, preferably the physical 
information is polarization information, the imagable 
electromagnetic radiation is polarized, a response of 
the detector elements is polarization-sensitive and the 
10 images are based on polarization from the surface. 

Further in carrying out the above objects and 
other objects of the present invention, a system is 
provided for carrying out the above method steps. 

The above objects and other objects, features, 
15 and advantages of the present invention are readily 
apparent from the following detailed description of the 
best mode for carrying out the invention when taken in 
connection with the accompanying drawings. 

Brief Description Of The Drawings 

20 FIGURE 1 is a schematic view of a machine 

vision system including an optical head for carrying out 
the method and system of the present invention; 

FIGURE 2 is a schematic view illustrating the 
details of a first embodiment of the optical head of 
2 5 Figure 1; 





FIGURE 3 is a schematic view illustrating a 
.second embodiment of the optical head of Figure 1 
wherein a grating is introduced on the imaging side to 
create an optical moire pattern; and 



5 FIGURE 4 is a schematic view illustrating 

another embodiment of the invention wherein a pattern of 
polarized electromagnetic radiation is projected. 

Best Mode For Carrying Out The Invention 

Referring now to Figure 1, there is illustrat- 
10 ed schematically a machine vision system, generally 
indicated at 10, including an optical head, generally 
indicated at 12, for carrying out the method of the 
present invention. The method and system 12 of the 
present invention are provided for high speed, scanning 
15 phase measuring of an object 14 at a vision station 16 
to develop dimensional information such as height 
information of a surface 18 of the object 14. The 
object 14 moves relative to the optical head 12 as 
indicated by arrow 20. 

20 In general, the invention relates to the non- 

invasive three-dimensional measurement of surface 
contours using technology such as moire technology with 
a novel approach that allows continuous scanning of a 
surface. A more general adaptation of this approach 

25 allows the measurement of other optical parameters via 
the same scanning approach but with a different optical 
configuration. 

The machine vision system 12 typically in- 
cludes an image digitizer/frame grabber 22 electrically 
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coupled to the optical head 12. The image digitiz- 
er/frame grabber 22 samples and digitizes the input 
■ images from an image source such as a camera contained 
within the optical head 12 as described in detail herein 
5 below. The frame grabber 22 places each input image 
into a frame buffer having picture elements. Each of 
the picture elements may consist of an 8 -bit number 
representing the brightness of that spot in the image. 

The system 10 also includes a system bus 26 
10 which receives information, from the image digiti- 
zer/frame grabber 22 and passes the information on to 
the IBM compatible host computer such as a Pentium PC 
28 . 

The system 10 may include input /output cir- 
15 cuits 3 0 to allow the system 10 to communicate with one 
or more external peripheral devices such as a drive 31 
or robots, programmable controllers, etc. having one or 
more stages. The drive 31 provides relatively uniform 
and continuous movement between the object 14 and the 
20 head 12. The I/O circuits 30 may support a three axis 
stepper board (i.e. supports multiple axis control) or 
other motion boards. 

As illustrated in Figure 2, a camera of the 
optical head 12 preferably includes a solid state image 

25 sensor such as a trilinear array camera 24. For exam- 
ple, the camera 24 may be the Kodak CCD chip model KLI- 
2103 which has 3 rows of detector or sensing elements 25 
each having 2 0 98 CCD sensing elements per row. Each row 
is physically separated by a distance equivalent to 8 

3 0 pixel elements. The camera 24 was originally designed 
for color scanning with a red, green, and blue color 
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mask over each element, respectively. For the. present 
invention, the masks are not used but rather are re- 
moved . 

The system bus 26 may be either a PCI, an 
5 EISA, ISA or VL system bus or any other standard bus. 

The image digitizer/f rame grabber 22 may be a 
conventional three channel color frame grabber board 
such as that manufactured by Imaging Technologies, or 
other frame grabber manufacturers. Alternatively, the 
10 image digitizer/frame grabber 22 may comprise a vision 
processor board such as made by Cognex. 

The machine vision system 10 may be programmed 
at a mass storage unit' 32 to include programs for image 
processing and/or image analysis, as described in 
15 greater detail hereinbelow. 

A monitor 34 is . also provided to display 

images . 

Referring again to Figure 2, generally, multi- 
ple images with different phases are obtained by moving 

20 the surface 18 of the object 14 while keeping a pattern 
36 projected by a light strip projector 38 and the 
camera 24 stationary with respect to each other within 
the optical head 12. The optical head 12 (i.e. when the 
system 10 is a scanning moire system) has no mechanical 

25 or optical mechanism that changes the position of the 
projected pattern 36. To obtain multiple phase images, 
there is relative movement between the optical head 12 
and the measured surface 18 . 
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Although taking images with movement in any 
direction could result in the ability to obtain phase 
shifts, there is only discussed herein two specialized 
cases. The first case is movement of the object 14 in 
5 a direction 20 perpendicular to an optical axis of a 
lens 40 of the camera 24 thereby creating a camera 
image. The second case is movement of the object 14 in 
a direction parallel to the optical axis of the lens 40 
thereby creating a second camera image. 

10 As with CCD linear array scanning, the object 

14 is moved in the direction 20 which is perpendicular 
to both the optical axis of the linear array camera lens 
40 and the line of pixels in the linear array camera 24. 
Thus, as the linear array camera 24 is read out line by 

15 line, the image of the object 14 moving past is created 
row by row. Using the trilinear array camera 24 for 
scanning produces three images of the scanned surface 18 
with each image being offset by a certain number of 
rows. This offset is a function of the spacing between 

20 arrays and the rate at which the image of the surface 18 
is moved -past the sensing elements 25. 

J The concept of scanning phase measuring of the 

present invention is analogous to the color sensing by 
the above-noted color trilinear array except the color 
25 filters are not present and each of the three scanning 
lines measures a different phase of the projected light 
pattern instead of the color. 

In terms of phase shifting technology, each 
scanning line measures a different "bucket," and a three 
3 0 "bucket" algorithm is used on the computer 2 8 for 
measuring the phase of the projected light pattern and 
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this phase is proportional to the surface height of the 
object being scanned. 

Before the phase is calculated from the 
readings at each of the scanning lines, the three 
5 scanned images are registered so that the phase informa- 
tion from each of the three buckets is from the same 
point on the scanned surface. The registration correc- 
tion and the calculation of the phase could be continu- 
ous if the electronics can accommodate this mode of 
10 operation. 

As described above, three scanning lines are 
utilized. However, there is no reason that more scan- 
ning lines cannot be used to increase the number of 
buckets used in the phase calculation or to average more 

15 than one scan line for a bucket. For example, if one 
had 16 scanning lines, the sum of lines 1 through 4 
could be used for bucket 1, the sum of lines 5 through 
8 could be used for bucket 2, the sum of lines 9 through 
12 could be used for bucket 3, and the sum of lines 13 

2 0 through 16 could be used for bucket 4. 

Case 2 alluded to above would most likely use 
a CCD area array in the optical head 1 but could use a 
linear array or single point photodetector . In this 
case, as the surface 18 is moved toward or away from the 

2 5 optical head 12, images are taken as the phase of the 

projection changes. The analysis would consist of 
correcting for registration between images and then 
using the images to create the buckets needed for the 
phase calculation. If the camera images telecetrically 

3 0 or nearly telecetrically, then registration would not be 

required. 
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Sys terns that employ the Case 2 set-up have 
been described for use in white light interf erometry 
systems as described in U.S. Patent Nos . 5,398,113 and 
5,355,221 but not for a moire (light stripe) applica- 
5 tion. 

Although a method is described above for 
making phase calculations based on a moire (light 
stripe) system, the described technique could also be 
applied to any optical base phenomena where the phase is 

10 changed between the images created when moving the 
object 14 of interest relative to the optical head 12. 
Techniques that can create this phase change include 
moire interf erometry , white light interf erometry , 
standard monochromatic light optical interf erometry , 

15 ellipsometry, birefringence, and thermo-wave imaging. 

The use of polarization to create an ellip- 
someter illustrates another optical based phenomena 
where phase is changed between. the images created when 
moving the object 14 of interest relative to the optical 

20 head 12. The adaptation of this scanning phase measur- 
ing technique to ellipsometry and birefringence measure- 
ment can be understood as an adaptation of a rotating- 
analyzer ellipsometer (as described at pp. 410-413 of 
the book entitled "Ellipsometry and Polarized Light," 

25 Azzam and Bashara) . The rotating-analyzer ellipsometer 
projects polarized light onto a surface and the polar- 
ization of the reflected beam (or transmitted beam 
depending on geometry) is determined by rotating an 
analyzer (linear polarizer) in front of the receiving 

3 0 detector. The radiation received at the detector varies 
as a sinusoidal function that it twice the frequency of 
the rotating analyzer. The amplitude of the signal is 
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to the degree of linear polarization of the light 
received at the analyzer and the phase defines the angle 
of polarization . 

Using the scanning phase measuring technique 
5 of the present application, the rotating-analyzer would 
be replaced by three or more analyzers, each of which 
would have a row of detector elements (scanning lines) 
behind it to image the received radiation at difference 
polarized phase values. The object to be measured would 

10 be moved past the fixed projector and detector system on 
an optical head 12'' as shown in Figure 4, wherein 
polarized light would be projected (instead of a light 
stripe pattern as described for a height measuring 
system) . Each of the scanning lines measures a dif fer- 

15 ent phase of the sinusoidal polarization signal. 

Items in Figure 4 which have the same or 
similar structure and/or function to the items in the 
prior figures have a double prime designation. For 
example : , 
20 • Reference numeral 12'' designates an optical head 
of a scanning phase measuring ellipsometer ; 

• Reference numeral 14'' designates an object whose 
polarization response will be measured; 

• Reference number 18'' designates a surface of the 
25 object 14'' whose polarization response will be 

measured when using a projector 38''; 

• Reference numeral 20'' designates relative motion 
of the measured object 14''; 

• Reference numeral 24' ' designates a trilinear array 
30 camera having analyzers 25''; 

• Reference numeral 36'' designates projected polar- 
ized light; 
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• Reference numeral 38' ' designates a polarized light 
projector for a standard ellipsometer ; 

• Reference numeral 40'' designates an imaging lens; 
and 

5 • Reference numeral 42' ' designates a polarized light 
projector for an ellipsometer in a transmission 
mode (biref ingence measuring system) . 

Reference numerals 60, 61 and 62 designate an 
analyzer system in front of detector lines wherein 6 0 
10 designates a linear polarizer parallel to the linear 
array 24'', 61 designates a linear polarizer at 45 
degrees to the linear array 24'', and 62 designates a 
linear polarizer perpendicular to the linear array 24' ' . 

The example shown in Figure 4 uses a trilinear 
15 array camera 24'' with the analyzers (linear polarizers) 
25'' set at 0", 45", and 90' for the three scanning 
lines. In terms of phase shifting technology, each 
scanning line measures a different "bucket," and a three 
"bucket" algorithm is used on the computer for measuring 
2 0 the phase and amplitude of the signal received by this 
scanning analyzer system. 

Referring again to the first embodiment of the 
invention, the optical head 12 includes the light strip 
projector 2 8 and the camera includes the imaging lens 4 0 

25 for focusing the scanned surface onto the trilinear 
array 24. The scjjined surface is translated past the 
optical head 4^yJ-n the direction of the arrow 20, To 
eliminate perspective effects in both projection and 
imaging, the project and imaging system should be either 

30 telecentric or nearly telecentric . A nearly telecentric 
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system is created by having the standoff from the optics 
being much larger than the measurement depth range. 

For this discussion, the data from the first 
linear array in the detector is called bl (for bucket 
5 1) . Likewise, the second and third linear arrays is 
called b2 and b3 , respectively. The pitch of the 
projected light pattern creates a phase difference of 
1/2 a cycle between bl and b3 . For each linear array, 
let bl(i,j), b2(i,j) and b3{i,j) designate the light 
10 intensity measurement for each linear array with j 
indicating the pixel number and let j indicating the 
scan number. For example, b2 (25,33) would be the 
intensity reading of the 25 pixel of the second linear 
array taken from the 3 3 scan. 

15 The phase value which is proportional to depth 

is calculated within the computer 28 using the light 
intensity reading from the trilinear array as the object 
14 is moving uniformly past the optical head 12 . The 
preferred equation is: 

2 0 phase value(ij) = arctan[ {bl(ij)-b2(ij+m)} / {b2(ij+m)-b3(ij+2m)} ] 

where m is an integer that provides the required image 
shift to match registration between bl, b2 and b3 . 

In like fashion, the preferred equation for 
amplitude value is: 

2 5 amplitude value(ij) - (((bl(ij) - b2(i j+m))^ + (b2(i j) - b3(ij+2m))^)'/' 

In some instances, it is desirable to project 
from more than one angle. For example, projecting from 
each side of the camera can reduce occlusion problems. 
Projecting with patterns having different contour 

3 0 intervals (the change in depth for one phase cycle) can 
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be used to eliminate ambiguity if the measurement range 
is more than one contour interval. 

Measurements with more than one projector by 
including a second projector 42 can be accomplished by 
5 cycling the part past the optical head and changing 
which of the projectors 38 or 42 is on for each cycle. 
Or, one of the illuminating projectors 38 or 42 can be 
changed for each scan of the array. For example, 
assuming two projectors, when j is even, the first 

10 projector 3 8 would be on and when j is odd, the second 
projector 42 would be on. For calculations to work out 
properly for this alternating system, then m, the 
integer shift value, must be even. Thus, using this 
alternating approach, phase value image for the first 

15 projector 3 8 would be: phase value (i,2j) where 
j=0,l,2, . . . ; and phase value image for the second 
projector 42 would be: phase value (i, 2 j+1) where 
^ — 0 , , 2 , • • • • 

If it is desirable to increase the pitch of 
20 the imaged grating pattern, a second grating 44 can be 
added to the imaging side as illustrated in Figure 3. 
In some instances, it is desirable to include an imaging 
lens between the grating 44 and the array 24. The parts 
shown in Figure 3 which have the same or similar func- 

2 5 tion to the parts of Figure 2 have the same reference 

numeral but a prime designation. 

The beat effect between the two grating 
patterns is the optical moire effect and will increase 
the pitch imaged onto the detector. This can be desir- 

3 0 able when one wants to use a pitch finer than can be 
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resolved by the detector. That is, the primary pitch is 
less than the width of a pixel. 

While the best mode for carrying out the 
invention has been described in detail, those familiar 
5 with the art to which this invention relates will 
recognize various alternative designs and embodiments 
for practicing the invention as defined by the following 
claims. 
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